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ABSTRACT 

The National Assessment of Educational Progress 
(NAEP) was created in 1969, and its goals were twofold: to make 
available the first comprehensive data on the educational attainments 
of young Americans in 10 learning areas and to measure any growth or 
decline that takes place in the educational attainments of young 
Americans. In 7 of the 10 learning areas s'urveyed nationallyreading, 
writing, science, music, citizenship, social studies and 
literature-achievement levels for the poor, the black, those who live 
in the inner city, in rural communities or the Southeast fall 
consistently below that of the nation as a whole. Young people who 
live in the Northeast or in suburban communities, or whose parents 
had the advantage of post-high school education, consistently 
demonstrated higher levels of skills and knowledge than the nation as 
a whole. The remainder of the report is concerned with the assessment 
of NAEP findings by educators, federal agencies and MAEP, research 
applications, aiding state efforts, NAEP and local school districts, 
teacher training and NAEP, and the present and future of NAEP. 
(RC) 
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Preface 



When annual publii* expenditures for education soared past the 
$M) billion mark in the early 196()^, taxpayers, educators, state legis- 
lators and the Congress began asking about the effectiveness of in- 
creased funding. Had it helped increase pupil achievement? Had the 
money been spent on the right things? Had the expenditure been large 
enough? 

To help answer these questions, the National Assessment of Edu- 
cational Progress (NAEF) was created in 1969. Its goals are two- 
fold: 

•1 o make available the first comprehensive data on the educa- 
tional attainments of young Americans in U) learning areas; 

• To measure any growth or decline that takes place in the educa- 
tional attainments of young Americans. 

rhe information provided by the national assessment project is 
proving useful to educators and policymiiiSfersJn several ways. The 
data NAEP gathers describes educational strengths and weaknesses, 
identifies pockets of educational disadvantage in the nation and pro- 
vides information for measuring the effects of federal education pro- 
grams. In addition, NAEP makes its methods and materials available 
for application iii a wide variety of evaluation needs. 

The project is financed by the U.S. Office of Education and man- 
aged by the Education (Commission of the States (EC^S), a coalition of 
governors, educators and legislators from 43 states, the Virgin Islands 
and Puerto Ri<c). EClS's purpose is to promote cooperative action in 
improving education at all levels— preschool through postsecondary. 

— (iaye Vandermyn 
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National Achievement Patterns 

Thf edurational ac hievement of young Amerirans who are poor or 
black, who live in the inner ( ity, in rural i'(»mmunities or m4he South- 
Ciist lags behind national levels in a broad range of subjects tradi- 
tionally taught in the nation*s s( hools. 

That observation, olten voiced by educators as an "informed 
opinion/-' has been documented by the largest, most ambitious educa- 
tional survey project in the nation, the National Assessment of Edu- 
cational Progress (NAKP). Results of the assessment surveys also 
reveal the size of the achievement gap. 

In seven of the H) learning areas surveyed nationally by the proj* 
Vi\ reading, writing, science, music, citi;^enship, social studies and 
literature aihievement levels for these groups fall ctmsistently below 
that of the nation as a whole. In contrast, young people who live in the 
Northeast or in sulmrban communities, or whose parents had the 
advantage of post-high school education, consistently demonstrate 
higher levels of skills and knowledge than the nation as a whole. That 
achievement pattern is illustrated in the graphs showing achievement 
levels for groups of 17.year-olds (h'igs. 1-4). Fhe pattern also hoKis 
true at the cither three age levels assessed: ages 9, 13 and 26-33. 

Results of the mathematics assessment will be released in 1974-75 
and the art and career and occupational developnient survey findings 
in 1973.76. 

Nearly a half million young Americans have participated in the 
assessment project over the past five years. By 1975, they will have 
completed test questions and exercises in all 10 learning areas. Since 
this is the first national data of this type gathered, educators and 
policymakers are evaluating the findings to determine whether these 
national achievement levels are satisfactory. 

What is obviously unsatisfactory to the American ideal of equal 
outcomes fnmi equal educational opportunity is the relationship be- 
tween poor achievement and socioeconomic influences. 

Initial assessment results reveal, more accuratelv than any previ- 
ous kind of survey, what achievement levels exist. 

Some examples of the kinds of informaticm NAEP has providedMn 
the seven subject areas assessed so far: 

Social Studies (1971-72) 

Young .\meri( ans lack knowledge of the fundamentals of politics 
and civil rights. Only 41 and 44 per cent of the nation*s 17.year-olds 
and young adults can a<< urately read all parts of a ballot. Only 17 per 
cent of the 13-year-olds, 49 per cent of the |7.year-olds and 60 per 
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cent of the adults know that the presidential candidate for each pnlit* 
ical party is formally nominated at a national convention. Many young 
people express reservations about granting constitutional rights when 
laced with specific circumstances. Relatively few young Americans 
( an read and interpret graphs* maps or tables. I'hey demonstrate little 
kmmledge of the contributicms of minorit\ g^^ups to American cuU 
ture and history. 

Citizenship (1969-70) 

An overwhelming majority of P-vear-olds (77 per cent) and young 
adults (8() per cent) know one or more ways citizens can influence the 
actions of their state government. A rough indicator of how well in- 
formed young people are about what is happening currently in govern- 
ment, results sh(m' that only 15 per cent of the 17.year-olds can name 
their l .S, senators; 31 per cent know the name of the congressman 
from their district; 7 per cent can name the secretary of state. (At the 
time of the assessment, William Rogers was secretary of state.) Of the 
young adults, 31 per cent can name l)oth senators from their state; 
3^ per cent know who their congressmen are; 16 per cent can name 
the secretary of state. The vast majority of l7.year-olds (88 per cent) 
and young adults {^)r^ per cent) can name the two major political 
parties, but substantially fewer (4 1 per cent and M per cent) can name 
a third party. 

Science (1969-70) 

NIales show an advantage in science at all ages. At age 9, male 
overall performance is only 1.8 per cent above females, but at age 13, 
males are 2^) per cent above females; at age 17, 5 per cent above fe*^ 
males; and between the ages of 26 and 35, 9.9 per cent above females. 
At all four age levels, males demonstrate a more thorough knowledge 
of physical science, and women seem to have a better knowledge of 
biological science. This trend is particularly apparent at the adult 
level where women appear to know a good deal more about human 
reproduction. Black Americans demonstrate the lowest science 
achievement of all groups reported. I hey are, overall, 15 percentage 
points below the naticm. 

Reading (1970-71) 

Most Americans read well enough to accomplish simple, practical 
kinds of tasks. Results do support stereotypes and suppositions many 
people have al)out good and poor readers. The overall reading ability 
of blacks, for instance, is lower than for any other group in the sur* 
vey. School-age males read less well than school-age females, but 
adult men and women have about the same reading abilities. People 
who come from families where neither parent has gone to high school 
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and people from inner t ity areas read less well than mosi other groups 
of people. 

Writing (1969-70) 

Males are more adventurous and free in writing es lys, although 
females demonstrate a hetter command of skills. Mastery of basic 
skills, such as punctuation and spelling, improves from age 9 to 1.^ to 
17 to young adult. Application blanks may be a common writing task 
for Americans, bat results show 61 per cent of the 17.y ear-olds and 50 
iper cent of the young adults actually fill in all information required. 

Literature (1970-71) 

Seventeen-year-olds overwhelmingly believe the study of literature 
is a positive experience. Ninety per cent believe literature should be 
part of every high school curriculum. About 10 per cent believe the 
study Tfrf literature increases ime's tolerance for new and different 
ideas. Responses to literary works vary, depending upon the age and 
sex of the student as well as the kind of work he or she is reading. 
Girls write better essays about literature than do boys. Inner city 
students seem to respond more completely to works that relate to their 
experiences or surroundings. 

Music (197M2) 

Individuals at all ages are interested in and like music. Over 80 
per cent of all age groups either play or would like to learn to play a 
musical instrument. Far fewer individuals can actually play an in* 
strument, however. Data on other music performance skills show that 
less than \? per cent of any age group can sight read even the simplest 
line of music. Judged on their ability to maintain pitch and rhythm and 
hit the right notes, fewer than half of the nation's youth can give an 
acceptable vocal performance of their own choosing. Black Americans 
demonstrate a greater ability to repeat rhythmic patterns than do 
whites. Black 9-, 13- and 17.year-olds score 7 to 8 percentage points 
above whites when repeating and improvising rhythmic patterns* 

Successive assessments will show whether progress is made in 
bringing educationally disadvantaged groups up to national levels 
and whether national achievement levels are maintained, improved 
or lowered. 

Second Science Assessment (1972-75) 

The second assessment of science provides* the first information of 
this type ever available to the education community and policymakers. 
A detailed report comparing 1969.70 science assessment resuhs with 
the 1972-73 survey findings will be available in early 1975. High- 
lights of the findings, available now, show that: 



EKLC XAEP/ECS Report A«. 48 



5 



PIQURB 3: Bducational 
Aehiewement 0f 17-Year-Olds: Raee 



RACE 



'/.Above 
Nafional 



15 



10 



Black 



White 



National ^ 

'/•Below ^ 
National 

10 
15 

2Ql 



t 



1 



'8 1 1 1 . 

S i o £ 3 ; 



•11.9 



19£ 



9.8 



164 -ISP 



■5.7 



■11.2 



4^2.0 



4^.8 



+1.7 



4-3.2 



4-1.9 



4-1.2 



4^.5 



Q) O) ^ m 

sill 



1 



S AEP/HCX Report No. 48 



• On most exercises measurint? siience knowledge and skills, 
achievement declined at alt three school ages assessed — 9, 13 
and P years; 

• On exerc ises used at ages 13 and P in Ijoth assessments, 
naticmal performance improved on about one-third ol the exer- 
( ises and dei lined oi\ about two-thirds ol* the exercises; 

• At the three schooUage levels, size of the dec line in overall per- 
fornicmce was l)etween one and two percentage points, enough 
of A drop to fall outside the margin of error aHcmrd in the statis- 
tical analysis of the assessment results. 

Three low-achieving grc»ups improved their standing relative to 
the nation. Relative "performance of Southeasterners at all three 
school ages improved on at least two-thirds of the exercises, bringing 
this group a litde closer to national achievement levels. Likewise, 

13- and I "-year-olds attending rural schools improved their 
overall performance, relative to the nation, by approximately three 
to four percentage points. In general however, rural respcmdents 
still performed l)elow the nation as a whole. Inner city 9- and l3-year- 
olds also gained on the national ac hievement level fn science, showing 
an overall improvement relative to the nation of about one percentage 
point. Inner citv respondents still performed generally below the na- 
tion. 

Black *>-vear-olds maintained the achievement levels established 
in the first science assessment, black 13-year-olds lost ground slightly 
and black P-vear-olds gained slightly. Blacks still showed an overall 
deficit of lietween 11 and Ift percentage points below the naticmal 
level. 
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Educators Assess NAEP Findings 



After the release of the first assessmetit t esults in si iente. reading, 
social studies and music, NAtlP invited appropriate professional 
education grou[)s to use the project's technical and consulting services 
to evaluate asse;isment findings. IVo such cooperative efforts, with 
the National Council of Social Studies (NCSS) and the National 
Science Teachers Association (NSTA), involved long-term formal 
study projects. The professional educators have evaluated the sig- 
nificance o\ the survey results, identified curriculum strengths and 
weaknesses, recommended instructional changes and compared actual 
performance levels with desiral)le performance standards as estimated 
i>y subjec t-area specialists. 

Working cooperatively with— and under a grant from— NAEP, 
NCSS assigned a team of experts to examine the assessment and in- 
terpret thi' data for social studies educators and curriculum planners. 
In one aspec t of the study, comparisons l)etween actual assessment re- 
sults and satisfactory performance levels set by a panel of social 
studies experts give c ause for concern. Actual assessment results show* 
a consistently lower level of understanding than ihe NCSS panel 
members considered satisfactory. Figure illustrates the discrepancy 
between what the experts judged would be satisfactory and actual 
achievement on seven exercises dealing with knowledge and attitudes 
about selected political and social issues. Kor example, although the 
panel believed that at least HO per c -nt of the young aduhs should 
understand the mwination procedure for presidential candidates, 
cmlv 60 \h r c ent actuallv did so. 

The May 1^74 mue of Snaal K'iucatinn, official journal of NCSS, 
is devoted largely to reporting On the NCSS interpretive effort. Jean 
Fair, pn^ferfsof Of education at Wayne State I'niversity, writing in 
(hat issue, states. . typical performance on citizenship exercise^; 
of school-age ycmng people (ages l.^ and P) in school communities 
categc^rized as inner city is below the nation as a whole; the ;ypical 
performance of ^uch young people is aljove in school communities 
c ategc^ri/ed as aflluent sul)url). That few of us are surprised makes the 
statement no less signific ant. Attention must be paid. The complexity 
of the proldems does not justify sweeping them under the rug. IVue, 
composite (single) scores do olwcure. Performance levels reported in 
the data are uneven; on sc^me few exercises inner city young do as well 
or better than the nation as a whole while the affluent suburban oc- 
casionally falls l>clc)w Study of the 'type of community' evidence points 
to areas of needed and overdue educaticmal effort. That large propor* 
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tions t)l" imier tity young people are memljers ol" minority groups 
simply adds to the urgency of the need. L'niess thfre is reason to be- 
lieve otherwise, the proper questions are why and what to do." 

NC..SS is s( heduled to publish the lull report ol its assessment study 
by the fall of \^)'7A. It is expected to include a nwre detailed analysis 
of assessment findings, exercises and oljjectives as well as recommenda- 
tions for improving social studies edi«<»tion. 

Science 

In science, the N.STA study team found that the national achieve- 
ment levels revealed in the first assessment, on the whole, tended to 
match or exceed their estimates of satisfactory performance. However, 
the N.STA report expressed concern over the relatively low-achieve- 
ment levels of females, blacks, rural, imier city and .Southeastern res- 
idents in all areas of the science assessment. 

In the N.S r.\ rep(»rt. major recommendatit>ns Ibr correcting educa- 
tional inequities and curriculum weaknesses included the following: 

• N.STA should appoint a committee to identify factors that may 
be restricting the sc ience achievement of women; 

• .Schools should provide sex education. (The poor performance 
<if 17.year-olds and yoimg adults, especially, on those exercises 
assessing sex education indicate that "parents may not know 
enough about sex education to be competent teachers of their 
children in this area." the NSTA report contends.); 

• Teachers should take a hard look at science curriculum content • 
priorities and instructional methods to improve retention of the 
most important scientific principles and information; 

• Teachers should carefully evaluate their methods and attitudes 
to make sure these do not discriminate against blacks, females 
and poor students. ^ 

Copies of the abridged report appeared in The Science Teacher, 
Scu /ur and Children and Journal of College Science Teaching. Un- 
abridged copies are available from N.STA. 

Beading and Music 

NAKP's ( ooperation with reading and music education specialists 
was slightly different. Reading specialists from around the country 
were inviteid to a workshop-symposium at the Denver headquarters 
of the project. They were asked tcj review the manuscript of a reading 
assessment report, analyze the significance of the findings, suggest 
possible causes for the achievement patterns revealed and ways in 
V hich inequities and deficiencies might be corrected. Their conclu- 
sion.9 were published in a report. Rectpes, Wrappers, Reasoning and 
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Hate: A Digest oj the First Heading AsseMitnent, which is available 
through the Superintendent of Documents. V. S. CJovci nment Print- 
ing Office 

I pon the release oH the results of the first music assessment, the 
first objective information ever available tt) musi<- educattMs on student 
achievement, the Music Educators National Conference (MENC) 
accepted NAEP's invitation to study the survey results and their im- 
plications for music education in the nation's schools. A MENC 
panel provided the perspe<tive needed to interpret the music assess- 
ment results. Ctjpies oH its analysis. A Perspective on the First Music 
Assessment, also are available through the Superintendent of Docu- 
ments, f. S. (M)vernment Printing Office. 
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Federal Agencies and NAEP 



During the 1 973-74 school year, NAEP conducted a *'miniassess- 
mem*' of functional literacy skills for the U.S. Office of Education's 
Right to Read programv Unlike previous literacy studies which are 
based on a grade-level reading ability or number of years of schooling, 
the miniassessment will test specific literacy skills of 5,200 17.year- 
olds. This assessment will be c^induo^ again in 1974-7S and 1975-76. 
.The Right to Read office developed- a definition of literacy based on 
mastery of skills and knowledges needed to function in modern society. 
Using that as the criterion, Right to Read selected appropriate exer- 
(ises for the miniassessment from those developed by NAEP in its 
regular reading assessment. Right to Read plans to use data collected 
by NAEP over a three-year period to gauge progress toward its goal 
of eliminating illiteracy by 1980 and to identify specific curriculum 
areas and programs that need strengthening!- 

Recommendations on how best to use Emergency School Aid Act 
allocations to improve the academic achievement of minority group 
students could be based, in part, on a special analysis of NAEP re- 
sults. A special study, now under way, was requested by the Na- 
tional Advisory (louncil on Equality of Educational Opportunity to 
assist it in formulating recommendations to the assistant secretary of 
education. The council is charged with advising the assistant secretary 
on kinds of programs that are most likely to accomplish successfully 
the goals of the Emergency School Aid Act. 

The analysis will compare achievement levels exhibited among 
groups of black students from different backgrounds in the annual 
surveys. In addition, it will provide performance data by both race 
and sex at each age on items that assess functional knowledge levels. 
Further requests for special analyses are expected through 1975. 

I he federal Office of Management and Budget in its new publica- 
tion, Soaai Indicators— 1973, uses NAEP findings exclusively for 
its information on levels of educational achievement. These indicators 
are used to show, in a timely fashion, the status of the papulation in 
relation to a particular concern, according to the publication. The 
educational achievement levels graphically illustrate the size of the 
*'edge" some population groups have over others in educational at- 
tainments. 
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Research Applications 



Kdiuational research (»r^nni/ati(»ns and (urricuium gr(»ups are 
also taking advantage of the survey methcKis, analysis techniques, 
educational ohje«tives, exercises and iindings pioneered l)y the NAEP 
project staff. 



Florida State L'niveiHiitv. Tallahassee, under a National Science 
Foundati(»n grant, is conduc ting a nationwide study of the effectiveness 
of a science curriculum approach called the Individij^li^ed Science 
Instruction Sysiems (iSlS). The evaluatiorr; project is using selected 
NAKP exercises to develop a measurement tend for its study. When 
the testing instrument is completed, the university will measure the 
level of science achievement mastered hy high school students using 
the ISIS .ipproac h in seven areas in the United States. 

Under a I .S. Office of Education grant, the Texas Education 
Agency in conjunction with the University of lexas at Austin com- 
pleted a research effort aimed at identifying the specific knowledge, 
skills and abilities thai distinguish the adult who can function success- 
fully in modern soc iety. Test items used to identify successful perform- 
ance in the survev of 4,1 15 adult volunteers frc^m 30 states included 
exercises develc^ped and used hy NAEP. Findings of the Adult Per- 
formance Eevel Study were pul)lished in January 1974 and are avail- 
able from the Universitv c^f l exas. 

NAEP is currently cooperating with the Atlanta Assessment 
Prciject and the Atlanta, (ia.. public schocds on a unique educational 
survey. Thejpurpose of the survey is to determine whether I7.year- 
olds, bc»th students and nonstuclents, are learning the minimum 
amount needed tc» cc»pe with life in Atlanta as it is likely t(» be in 1 
Funded under the Elementary and Secondary Education Act (ESEA), 
Title ill, Atlanta staff are studying the methods used by NAEP to 
measure attitudes and values, one of the most difficult areas in w*hic h 
to develop relialile measures. 
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The national assessment also has provided consultation, technical 
assistance and materials to an ESEA Title V program* the (Cooper- 
ative Ac(cmnlal)iliiy Project. States engaged in the cooperative effort 
to refitie stale accounlaliility systems are (Colorado, Florida, Min- 
nesota, Wisconsin, Michigan, Oregon and Maryland. 
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Aiding State Efforts 



SAKP h*is provided nuisultiiiy scivicrs, irchniciil assist.iruo, iis- 
scssment miiteriiils .irui or (\ma to 2H states interested in developinj^ 
their (mn state education evaluation programs. The nature of the 
service the project provides ranges from exploratory and planning 
sessions with state edueaticm (»ftieials, governors and legislators to 
pr(»viding special materials for state use. 

In addition to assistance t(» individual state education agencies, 
NAEP annually sponsors a series of workshops on assessment methods 
which offer state (»ffi( iais an overview of the techniques and mjitCf 
rials of large-scale assessment pioneered by the national assessment, 
rhe workshops also afford state officials the opportunity to share ex- 
|)eriences in this reiativelv new field. 

To help slates develop greater expertise, NAEF also assisted six 
states in forming .1 new organization— the National Council for the 
Advancement of Kducational Assessment - which will explore mutual 
assessment problems on a continuing l)asis. Charter members of the 
new group include representatives from (^alifornia, Florida, New 
Jersey, New V()rk, Pennsylvania and I'exas. 

.Some states need no more than technic al assistance with the 
methods of large-scale assessment. Others find that the full range of 
materials. dcUa and services of the projec t can be economically adapted 
to fit their tieeds. 

Minnesota is exam[)le of a state that found it l)eneficial to adapt 
NAKF materials io its statewide evaluation and planning needs. In 
a study conducted in the spring of h^73, the state administered 100 
reading exercises io 4,(>IHI 17.yearM>lds in the state. I wenty-six of 
these were N.VKP exercises. (;t)mparisons on these 26 exercises show 
that Minnesota IT-vear-cdds are better readers than their counter- 
parts in the rest (►f the country. These results are cmly the beginning 
iA a 1 0-year state assessment [)rogram that will measure achievement 
i>f three age gnmps in 10 subjec t areas. Kxercises used in these surveys 
will again include NAKF exerc ises. 

Connecticut. f(»llowing its first statewide assessment in reading, 
was able tc» make direc t comparisons between state and national levels 
of ()erform.uice. Connecticut used this informaticm to plan more ef- 
fective use of state educ atiim resources. One outcome of that evalua- 
tion and [)lanning effort was a new stress on uriian reading programs. 
Connectic<:t will use NAKP exercises in a statewide science assess- 
ment in the fall of P)"^ ! 

Maine found, as a tesult of its first educational assessment of 
citizenship knowledge conducted in P)72. that the staters 17.year- 
olds in both private and public schc»ols demonstrate more concern for 
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the well-heins of others and the rishts o\ individuals th.m their peers 
nationally. The Maine assessment program closely parallels the 
NAKl* nu»del The Hrst assessment of < iti/enship and writing skills 
is part of a MJ-vear program planned to give Maine eduiation deei- 
sioomakers periodic progress checks on whether student performance 
is improving and wh.it areas of the curriculum need strengthening, 
(larroi R. N!c(iary. commissioner of the Maine State Department of 
Educational and Cultural Services, said that the state's first assessment 
had pinpointed two areas of civic education that need strengthening— 
t)etter understanding of the application of constitutional freedoms 
«md the development of practical skills of citi;t^en participation in 
government. 

Iowa used NAKF objectives and exercises in 1^71 and 1972 to 
assess .1 sl.itewidc sample of students in three academic areas — science, 
reading and literature. The Iowa assessment was designed lo find out 
how well state education objectives were being met. Iowa also uses 
NAKP m.iterials in its continuing assessment service to local school 
districts. The state helps local school officials tailor assessment meth* 
ods to local program evaluation needs. 

States that have employed the national assessment model, ma- 
terials or data in their own educational evaluation programs include: 

Colorado Louisiana Ohio 

Connecticut Maine Oregon 

Hawaii Maryland Virginia 

Illinois Massachusetts Wisconsin 

Iowa Minnesota Wyoming 

States that have used the project's consulting services to explore 
or start planning development of evaluation programs include: 

Alabama Florida South Carolina 

Arizona Idaho Texas 

California Michigan V^irgin Islands 

(ieorgia New Mexico West Virginia 

North Carolina 
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NAEP and Local School Districts 



Since its inception, NAEF has received mare than 2U0 requests 
from local school districts that wish to take advantage of the findings 
of the pt*oject and the methods it has developed in their own evaluation 
and curriculum reform efforts. 

One of the most thorough applications of the NAEP approach in 
a local district is the student writing demonstration project of Mont- 
gomery (Uiunty, Md., public schools. School officials in this suburban 
Washington area were interested in comparing the writing skills of 
their 13- and 17«year-olds to other suburban children. By using 
NAEP materials and drawing on NAEP's assistance, they were able 
to carry out a districtwide miniassessment of writing that revealed 
their youngsters were performing above national levels in all but a 
few instances. 

To stimulate the most effective use of assessment materials and 
methods, direct assistance to local school districts is based primarily 
on a 'iighthouse** concept. At this point, at least 12 school districts 
that are either participating in a state assessment effort or have dem- 
onstrated the staff and funding capability for carrying out an effective 
program have received direct assistance from the. NAEP staff. Since 
the NAEP staff is small, assistance to other districts has necessarily 
been limited to providing materials and wriuen monographs about 
the project *s methods, results and design. 

Following is a brief description of four 'iighthouse'' school dis- 
tricts that demonstrate the kinds of impact the project has on local 
school programs. 

Sail Bernardino^ Calif. 

In 1972 the San Bernardino school system undertook a major 
evaluation of its curriculum offerings and goals. The S300,000« 
project compared local curriculum objectives with the educational 
objectives developed for NAEP by panels of scholars, educators and 
interested citizens. The result was a total revision of local curriculum 
offerings and a new statement of educational goals. The San Bernar* 
dino effort illustrates the typical approach: adaptation of NAEP 
educational objectives to suit local values and needs rather than 
wholesale adoption. 

Lincoln^Neb. 

Lincoln school officials recently asked themselves: What should 
we be teaching? It was an attempt to take a fresh hard look at the 
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education needs of their students. When they found their answers, 
they looked to NAEP for help in finding out how well they were 
achieving those educational goals. Although the local school district 
developed its own answers to the critical question of what should be 
taught, they found that a nuniher of NAEP exercises reflected local 
district objectives. By selecting those exercises to use in their local 
evaluation program, Lincoln school officials were able to compare 
local student performance with national performance levels. Lincoln 
officials also took note of an added bonus: Because the district was 
able to duplicate the exercises and methods used by NAEP, they saved 
both time and money. 

The evaluation program showed that Lincoln students* overall 
achievement is superior or equal to national levels with a few specific 
exceptions. And it's to these few exceptions that Lincoln teachers are 
now giving added emphasis in the instructional program. 

. Shawnee M ission , Kan • 

The Shawnee Mission school district encourages innovation but 
wants to make sure that innovation pays off in better student achieve- 
ment. After school officials launched a new interdisciplinary cur- 
riculum project on American studies in 1973-74, they sought help 
from NAEP in developing means of evaluating its success. By in- 
corporating social studies exercises used in the national surveys, the - 
district hopes to gauge the comparative effectiveness of their new cur- 
— i4rulum approach. 

Milwaukee, Wis. 

Milwaukee education officials wanted to know how well students 
had mastered science subjects. To find out, the city used NAEP 
science exercises in a systemwide evaluation of science achievement 
in 1971. Milwaukee is using the information it gathered to plan cur- 
riculum approaches that will be effective in upgrading students* 
science achievement. 

Other school districts that have begun planning or are using the 
NAEP approach or materials in local evaluation programs include: 



Jefferson C^ounty Public Schools, Colo. 
Granite School District, Utah 
Philadelphia Public Schools, Pa. 
Denver Public Schools, (lolo. 
(Chicago Public Schools, III. 
San Diego Public Schools, (.alif. 
Columbia Public Schools, Mo. 
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Teacher Training and NAEP 

Feacher training institutions a( n^ss the country have started using 
NAEP materiah in professional education courses. Approaches vary 
with the kind of course and the institution, (ieneratly* courses dealing 
with educational evaluation include a study of NAEF's methods and 
materials; student teacher supervisors concentrate on studies of 
NAEP objectives and exercises; education methods courses compare 
educational objectives with the survey findings on student achieve- 
ment. 

Following are samples of such uses: 
University of Houston, Texas 

The CloUege of Education, University of Houston, uses NAEP 
data in its teacher education program that focuses on students' 
abilities to perform specific teaching skills successfully. Faculty, grad- 
uate students and seniors use the NAEP data for reference-based 
comparisfms in learning methods. 

The college language and reading faculty use NAEP exercises and 
objectives as a reference in developing objectives and exercises for 
use in their teacher-training courses. The department of curriculum 
and instruction examines NAEP methodology in a graduate course 
in teaching strategies. During the course of study, the class makes 
comparison studies of NAEP data in various subject areas. 

Western Michi jgan University ^ Kalamazoo 

Future teachers are shown how to use NAEP methods and data 
to evaluate student progress in their own future classrooms. Educa- 
tion psychology classes at Western Michigan University study the 
reading objectives and reports on survey fmdings to examine dif- 
ferences in pupil performance among regions, levels of parental educa- 
tion, ages, sexes, races and size and type of communities. Seminar 
courses in *'s(hc)ol and society'' study in detail the methods, data^ 
objectives and exercises. 

University of Georgia, Athens 

Elementary and high school te^jfhervkttending the Association of 
Teacher Educators (.XTE) sumnter wcjr^shop at the University of 
CJeorgia in Athens report they use N>^P materials from the social 
studies, reading and math assessment in their classes. The teachers 
note especially the usefulness of NAEP objectives and exercises as a 
reference in developing courses of study for their elementary and high 
school students. Curriculum development classes study NAEP data 
charts to make achievement level compariscms and examine practical 
applications of NAEP objectives and exercises. 
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Colgate University, Hamilton, N.Y. 

Student teachers and postgraduate teacher interns at (Colgate 
University use NAEF dbjectives. exercises and findings to make com- 
parison studies in their present training program. They are expected 
to apply this material later to their own classroom activities. 

Syracuse University, New York 

The mathematics department faculty of Syracuse University uses 
NAEP materials to plan the freshman course of study. The faculty 
has examined NAEP math objectives and exercises and hopes to use 
NAEP math survey findings, which will be released in late 1974, to 
plan an effective instructional approach for heterogeneous student 
groups. The data will tell them what achievement level to expect of 
incoming freshmen given certain factors such as region, sex, color, 
parental education and size and type of community. 

University of Illinois, Urbana 

Both English and education department faculties at the University 
of Illinois expose their students to NAEP materials developed for the 
1969-70 writing assessment. Future teachers also examiftOvNAEP 
data reports in writing that indicate how well 9-, 13- and H-year^ds 
have mastered specific writing skills. 

In other areas, members of the Association of Teacher Educators 
(ATE) were inspired by a program on NAEP to plan further presen- 
tations for their state organizations. 

The Mississippi ATE, headquartered at the University of South- 
ern Mississippi, Gulf Park, has scheduled a workshop for superin- 
tendents, principals, curriculum decisionmakers and deans on data 
use and model adaptation. 

The University of Wisconsin College of Education, Eau Clair, is 
inviting educators and publishers to a presentation and workshop on 
NAEP findings and their possible uses. 
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NAEF — Present and Future 



Because NAKF is the first attempt ever made to provide objective 
data on a systematic national basis about the educational competencies 
ot young Americans, it has broken new ground in education research, 

1*he project annually examines a stratified random sampling of 
nearly 1(10,0(10 individuals, providing the only truly representative 
national sample of specific educational competencies. 

The educational objectives on which the exercises are based in- 
clude the judgments oUay people and scholars outside the education 
profession, providing educators with valuable information about pub- 
lic expectancies and hopes for education. 

In addition to providing summary information about national and 
group achievement levels, NAEF reports both the actual answers of 
the participants and the exercises as they were presented in the as- 
sessments. This allows educators to examine the range of skill mas- 
tery, information and misconcepticms which young Americans pos- 
sess. 

The project also has developed achievement measures for subject 
areas previously thought too complex or difficult for a large-scale 
testing program— writing, music, art and career and occupational 
development. 

The ''test items** used by NAtJ' are not exclusively multiple- 
choice or even paper-and-pencil tests. To measure effectively such 
things as skill mastery, ability to apply knowledge and attitudes, 
participants may be asked to write a letter, participate in a group 
discussion on a specific topic, draw a picture, sing a song or give 
their reactions to a film. These approaches also minimise the effect 
poor reading skills usually have on an individuaPs successful per- 
formance on tests in other subject areas. 

l o make the naticmal survey data more useful, NAEF has begun 
work on two studv efforts that may lead to long-range modifications 
in the project. The first is an effort to identify major influences on 
achievetnent such as school characteristics or family eccmomic status. 
When these influences are defined, they will be considered for inclu- 
sion in NAEF surveys. 

The second effort is a response to the education community's re- 
quests for more indepth analysis of assessment results. NAEF is 
studying the feasibility of refming its group performance compari- 
scms so that, for example in addition to comparing achievement of 
9-year-olds from the Northeast with 9*year-olds from the Southeast, 
comparisons could also be made between black Q-year^^olds from two 
different regions. 'I*his additional level of information, educators be- 
lieve, would be helpful in pinpointing educational trouble spots afid 
in suggesting successful curriculum approaches. 
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